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ABSTRACT 

Unclassified historical data concerning the United States in- 
volvement in military conflicts is used to model the behavioral patterns 
of the past as a Markov Process. The stochastic properties of the 
model are calculated and their usefulness as tools in the study of 
cost-effectiveness is discussed. 
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I. A COST EFFECTIVENESS MODEL 



Within the last few years the term, "cost-effectiveness" has 
lost its formality while extending and diversifying its applicability so 
that it now includes all phases of system and component design, 
development, production and operation. The basic concept of cost- 
effectiveness analysis as an analytical technique for evaluating alter- 
native choices having economic and management implication has 
produced evaluation processes which are extremely sophisticated and 
complex, but which fail at times to provide the correct solution. The 
ability to make the correct decision involving an appropriate cost for 
a system under study remains difficult in itself and can be made 
virtually impossible if the decision-maker is led astray by analysis 
which is biased by the exclusion and/or inclusion of inappropriate 
cost categories. To determine the relative merits of various weapon 
systems it is imperative that the wartime cost categories be specifically 
identified and standardized. Another critical area, the mathematical 
relationship between cost and effectiveness, is still open to debate. 
This paper discusses these problems with regard to a military weapon 
system and develops a stochastic model which may assist in the 
search for correct answers . 

A simple categorization of the major cost categories for a military 
weapon system which can be used as a focal point for developing other 



cost guidelines is: 
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Research & Development Costs 



Peacetime Investment Cost 
Peacetime Operating Costs 
Wartime Investment Cost 
and Wartime Operating Cost 

In response to a similar list of cost categories TRW Systems 
Group has suggested, [Ref. 1], that system costs could be more ex- 
plicitly related to system effectiveness if both were evaluated at the 
same level of military activity. For example, system wartime effec- 
tiveness is evaluated under a variety of missions and scenarios, 
therefore, wartime operating costs should be similarly measured at 
various levels of war in order to increase the preciseness of the results. 
Additionally, since it is common for the life -cycle of a weapon system 
to span periods of peacetime and various levels of military activity, 
estimates of system life-cycle cost should include the utilization of 
weighting factors applied to the various operating costs in proportion 
to the probability of the United States being in a state of peace or 
appropriate level of military involvement during a given time period. 

And finally, a weighting factor related to the expected frequency of 
war should also be used to correctly apportion the contribution of 
wartime investment costs to the total life-cycle costs. 

As a first approximation, the military conflicts can be separated 
into the two categories of WAR and HALF -WAR relative to their intensity, 
number of casualties, etc. The stochastic properties mentioned above 
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can then be applied to the major cost categories to obtain a "top level" 
probabilistic, life-cycle cost equation for use as a guideline in final 
cost estimation and as a new analytical tool for gaining more insight 
into the resource requirements to be expected during a system's life- 
time. This was done by TRW Systems Group [Ref. 1] and the resulting 
life-cycle cost equation was: 

Life-Cycle Cost = (R&D cost) + (Peacetime Investment cost) 
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where the P's are the weighting factors based on the probability that 
the U. S. will be in a state of WAR, HALF -WAR, or NO-WAR in any 
year, k, and the n's are the number of transitions into the various 
states of war with both p and n being calculated over the system's 
total operating life span of T years. The investment cost per transition 
is a finite cost for war escalations and zero otherwise. 
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Using this approach the major categories of wartime costs can 



be tied explicitly to system wartime effectiveness analyses. 

A mathematical model was developed by TRW Systems Group 
[Ref. 1] for quantitative determination of the probabilities and frequen- 
cies of war under the following conditions: 

(a) The model operates in discrete time 

(b) The unit of time is one year 

(c) Historical data from 1900 - 1967 is considered 

The purpose of this paper is to develop a mathematical model to 
quantitatively determine similar probabilities and frequencies, but 
one which operates as follows: 

(a) The model operates in continuous time 

(b) The unit of time is one month 

(c) Historical data from 1775 - 1970 is considered. 
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II. HISTORICAL DATA 



The military activities of the United States considered significant 
in the context of this paper are those listed in The Encyclopedia of 
Military History [Ref. 2]. References 3,4, and 5 were useful in 
determining a precise commencement and/or termination date in the 
case of several of the conflicts being examined. 

For the purpose of categorizing the various levels of military 
involvement, the state of WAR is defined as a shooting war with troop 
and equipment losses which has a distinct effect on the economy of the 
United States. The state of HALF -WAR is defined as a state of military 
involvement where troops and equipment are deployed, but either losses 
are relatively light or the economy of the United States as a whole is 
relatively unaffected. The state of NO-WAR is the state of relative 
peace which exists when neither a state of WAR nor a state of HALF -WAR 
exists . 

The following interpretations were used to classify the historical 

data: 

1. The start of a WAR during a period of HALF -WAR causes a 
change of state from HALF -WAR to WAR. 

2 . The start of a HALF -WAR during a period of WAR causes 
no change of state. 

3. The start of a second, distinctly different, HALF -WAR 

during a period of existing HALF -WAR causes no change of 
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state, but simply permits the existing state of HALF -WAR 



to continue until the conclusion of the longer HALF-WAR, 
or a transition into a state of WAR occurs. This interpre- 
tation is taken because the calculations of cost-effectiveness 
in this paper depend only on the intensity of military 
activity and not on their theater of operation.' Similar con- 
ventions apply to the states of NO-WAR and WAR, hence 
transitions between the same two states are not possible. 

4. A change of state from HALF -WAR to WAR cannot occur as 
the result of a combination of concurrent HALF -WARS. 

5. The month during which a change of state occurs is evaluated 
as a month during which the new state existed. 

It is not the author's claim that this interpretation of data provides 
a precise categorization of the conflicts nor that the list of military 
activities considered is neither lacking nor in excess, but only that it 
provides a reasonable data base, consistent with the intent of the 
problem, to which an attempt can be made to fit a stochastic model. 

The remaining pages of this chapter contain a complete list of 
the military conflicts considered, along with their classification as 
states of WAR (W) or HALF-WAR (HW) in accordance with the proposed 
scheme and a graphical representation of the resulting sequence of 
state transitions (Figure I). 
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AMERICAN MILITARY ACTION 1775 - 1970 



STATE CLASSI- 



DATES 


ACTION 


FICATION 


Apr 1775 - Apr 1783 


War of the American Revolution 


W 


Nov 1798 - Sep 1800 


Quasi War with France 


HW 


Jul 1801 - Aug 1805 


Tripolitan War 


HW 


Nov 1811 - Jun 1812 


Indian War against Shawnees 
and Friction with Britain 


HW 


Jun 1812 - Dec 1814 


War of 1812 


W 


Mar 1815 - Jun 1815 


American War with Algiers 
(Barbary Wars) 


HW 


Nov 1817 - May 1818 


First Seminole War 


HW 


Apr 1832 - Aug 1832 


Black Hawk War 


HW 


Dec 1835 - Dec 1843 


Second Seminole War 


HW 


Jun 1835 - Apr 1836 


War of Texas Independence 


HW 


Mar 1846 - Feb 1848 


U. S. - Mexican War 


W 


Jan 1850 - Oct 1879 


American Indian Wars 


HW 


Apr 1861 - May 1865 


Civil War 


W 


May 1885 - Sep 1886 


Apache War 


HW 


Dec 1890 - Jan 1891 


Sioux War in South Dakota 


HW 


Apr 1898 - Dec 1898 


Spanish - American War 


W 


Feb 1899 - Jul 1902 


Guerrilla War in the Philippines 


W 


Jun 1900 - Oct 1900 


Boxer Rebellion in China 


HW 


Jul 1902 - Jul 1905 


Moro Campaign 


HW 


Nov 1903 - Nov 1903 


Panamanian Revolt 


HW 
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DATES 


ACTION 


STATE CLASSI- 
FICATION 


Oct 1906 - Dec 1909 


Army of Cuban Pacification 


HW 


Jan 1912 - Jan 1913 


Intervention in Honduras and 
Nicaragua 


HW 


Apr 1914 - Nov 1914 


Tampico and Vera Cruz Incidents 


HW 


Jul 1915 - Sep 1915 


Intervention in Haiti 


HW 


Mar 1916 - Feb 1917 


Mexican Border Operations 
against Pancho Villa 


HW 


Nov 1916 - Jul 1924 


Intervention in the Dominican 
Republic 


HW 


Apr 1917 - Nov 1918 


World War I 


W 


Aug 1918 - Apr 1920 


Expeditions into Northern Russia 
and Siberia 


HW 


Jan 1927 - Nov 1928 


Intervention in Nicaragua 


HW 


Jan 1931 - Jan 1933 


Intervention in Nicaragua 
(The Sandino Affair) 


HW 


Dec 1941 - Aug 1945 


World War II 


W 


Jun 1948 - Sep 1949 


Berlin Blockade 


HW 


Jun 1950 - Jul 1953 


Korean War 


W 


Jul 1958 - Oct 1958 


U. S. Troops to Lebanon 


HW 


Nov 1960 - Dec 1960 


U. S. Warships Protect 
Guatemala and Nicaragua 


HW 


Dec 1961 - 


U. S. Support Units Arrive in 
South Vietnam 


HW 


Oct 1962 - Nov 1962 


Cuban Missile Crisis 


HW 


Aug 1964 - 


Tonkin Gulf Resolution 


W 


Apr 1965 - May 1965 


Intervention in Dominican 
Republic 
14 
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Sequence of Transitions and Time In State 
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FIGURE I 



III. MARKOV PROCESSES 



This paper uses continuous time, finite state MARKOV Processes. 
The definitions and special properties of these and other terms which 
will be used later in the construction of the mathematical model are 
developed at this time to provide continuity in the later sections . 



A. FUNDAMENTAL DEFINITIONS 

A MARKOV PROCESS (MP) is a special type of stochastic process 
distinguished by the property that the distribution of its future behavior, 
when its present state is known, is not altered by additional knowledge 
concerning its past behavior. Specifically, letting {X ; t = 0} be the 
stochastic process, it's a Markov process if, 

X 



Pr(X = x 
t n 
n 



t ^n-l ' ^n-9 ' * * * 

n l n z t i. 

n-1 n-2 1 



Pr(X = x 
t n 
n 



X 



t ;vi> 

n-l 



where 



0 <t < t 0 < . . .< t 
= 1=2= = n 



A MARKOV CHAIN (MC) is a discrete time Markov Process, 

(n = 1,2,3,...), with a finite number of states . The common assumption 
that the transition probabilities are stationary, i.e., dependent only 
on the states i and j and not on the time n, is assumed in this paper. 

The law of motion for the process may then be described by the one 
step transition probabilities of going from state i to state j. 



p ij = Pr K „ + i = j 



x n=i) 
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A TRANSITION MATRIX is a finite array of real numbers which 



specify the one step transition probabilities of going from state i to 
state j , 



The classification of the states of a process become important 
when dealing with the asymptotic properties and also in the physical 
interpretation of the states. For Markov processes, the states are 
classified according to their limiting behavior. Given that a process 
is initially in state j , if the ultimate return to state j within a finite 
period of time is a certain event, state j is called POSITIVE RECURRENT. 
If a process starts in state j and subsequent visits to state j can only 
occur at times t, 2t, 3t . . . , state j is called PERIODIC with period t. 

A state which is not periodic is called APERIODIC . A state is ERGODIC 
if it's positive recurrent and aperiodic. 

In this paper all the states are ergodic and the properties 
developed will apply, although they are not necessarily restricted to, 
processes all of whose states are ergodic. 

An illustrative definition of a continuous time MP with a finite 
state space is that it's a stochastic process which moves from one 



»ij " Pr «nM = j X n = i) ' 



hence they satisfy the conditions that for every i and j, 



p. . > 0 

i] = 



s 



and 
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state to another among a finite number of states with successive states 



visited forming a Markov chain. The process stays in any state a 
random length of time, the distribution function of which is exponential 
and dependent on the current state as well as the next state to be visited. 
Define m.. as the mean value of the conditional exponential dis- 



tribution for the length of time spent in state i given that the next 



The unconditional mean length of time spent in state i will be 
a positive, finite value for every state considered in this paper, i.e. , 
0 < m. <00 



B. LIMITING PROPERTIES 

In order to obtain specific values for many of the expressions 
developed, it is necessary to use their limiting approximation as time 
approaches infinity. This limiting behavior is presented in this section. 

Given that a transition into state j occurred at time t = 0, the 
expected time until the process next enters into state j is called the 
MEAN RECURRENCE TIME of state j and is denoted by £, . The value 



of the mean recurrence time of state j is the summation, over all 
possible paths (9) which begin in state j and terminate at state j with 



transition will be into state j, and m. as the unconditional mean length 
of time spend in state i. The relationship between m_ and m. is 




x 



19 



no intervening visits to state j, of the probability of the path being 
taken multiplied by the expected time to traverse the path. 




£ ( !T p hk ) ( I 



(h,k) e 9 



m hk> 



Over a long period of time, (t -*-00), if all states are ergodic 
and rm < CD for every j, the probability of finding a Markov Process 
in any state j equals the ratio of the unconditional mean time spent 
in state j to the mean recurrence time of state j . 

Specifically: 



limit 
t + 00 



Pr (X. = j) = 




& 

] 



The above theorem with trivial alterations is proven by Smith [Ref. 6], 
After a period of time t > > g has elapsed, the expected number 
of transitions into state j is approximately the time t divided by the 
mean recurrence time for state j. Letting n (t) be the number of tran- 

j 

sitions into state j during [0,t], 



limit 
t -*■ 00 



n (t) 
t 




n. 

J 



The expected number of those transitions into j which came from state 
i is, in steady state, the number of transitions into state i times the 
probability of a transition from i into j. 



n. . = n.p. . 
i) i i] 
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C. SEMI MARKOV PROCESSES 

A generalization of the definition of a Markov process with regard 
to the distribution function of the time spent in each state results in a 
Semi-Markov Process (SMP) . 

A descriptive definition of a finite state SMP is that it is a 
stochastic process which moves from one state to another among a 
finite number of states with successive states visited forming a Markov 
Chain. The process stays in any state a random length of time the 
distribution function of which may depend on the current state as well 
as the next state to be visited. 

Notice that the only difference between a MP and a SMP is 
whether or not the conditional distribution of the length of time spent 
in each state is exponential . 

The development of the SMP which follows is based on that given 
by Pyke [Ref. 7] . 

Define Q_ (t) as the probability that, given the system starts 
in state i at time zero, the first transition is into state j and that it 
occurs on or before time t. 

Then Q = (0..), is an s x s matrix valued function defined on 
13 

(- 00, + 00), whose elements Q.. are non-decreasing functions 

13 

satisfying 

(1) 0. . (t) = 0 t < 0 

13 
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and 



( 2 ) 



s 

Q (+ 00) = 1 1 < i < s 

X) = = 



It now becomes natural to define 



p .. = Q.. (+ 00) 

i) 



and to assume that 



p. . > 0 i j 
ij 

and 

Plj = 0 1 = 1 . 

so that the s x s matrix, P = (p ) , becomes the transition matrix for the 

Markov Chain describing the sequence of states visited. 

The probability of leaving state i before any time t, independent 

of which state you go into next, is the unconditional distribution 

function of the time spent in state i and is 
s 

Q. (t) = Z Q.. (t) 1 < i < S 

The distribution of time in state i, given that the next transition 



will be into state j, is simply 



I 

4 = 1 



O. . . (t) = _2iL^ 

11 



i ¥■ j 



P ii 



The following notation is introduced to define the moments of 
the distributions thus far discussed. The conditional mean and con- 



ditional variance of the length of time spent in state i given that the 
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subsequent transition will be into state j, are respectively 
00 

m. , = / t d Q. ! . 

il J i|J 

0 

2 00 

a . . = j (t - m. ,) 2 d Q. ( . 

il J. U i| 1 

0 

and the mean and variance of the length of time spent in state i re- 
gardless of the subsequent transition, are 



00 

m, = J t d Q, (t) 

0 

2 00 

° . = J (t - m . ) 2 d Q. (t) 

0 “ 




Notice that the expressions developed for the asymptotic con- 
dition as t -*■ 00 and for the mean recurrence time are distribution free. 
They apply equally to a MP and SMP as long as the distribution function 
for the length of stay in each state has a finite mean. 



D. THE ALTERNATING PROCESS 

If the number of states is restricted to tv/o and the requirements 
maintained that 

P A - > 0 1 ^ 1 

and 
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p ir° 



i = j 



a SMP becomes an alternating renewal process since 



p >0 implies p =1 

ij ij 



i , j = 1 , 2 and i }4 j 



In an alternating renewal process the equation for mean recurrence 
time reduces to the sum of the mean length of time spent in each state, 
because the p_ equal either zero or one depending on whether or not 
i equals j, and is the same for both states, i.e., 

6 1 - 6 2 = m l +m 2 



The distribution function of the recurrence time is the convolution 
of the distribution functions which specify the length of time spent in 
each state. Further, the fact that 

G 1 * G 2 (y) = G 2 * G 1 (y) 



implies that in a two state alternating renewal process the distribution 

of recurrence time for each state is the same and may be called the 

recurrence distribution of the process. 

Let Yj and be random variables having distribution functions 

Gj and which describe the length of time spent in states 1 and 2 

respectively. The distribution of the recurrence time (G) , is the 

distribution of the random variable Y where Y = Y, + Y„ . 

1 2 



G(y) = 



y 

/ G 1 ( ' , - x 2 ) dG 2 (x 2’ 
0 
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As a specific example, let 



then 



_ a x X x 

(x) = 1 - e and (x) = 1 - e 

G(y)= Gl *G 2 =JT tl-e- “ <y ' x) ] x e" X x dx 

0 



7 

"I 



, - x x , 

a e dx 



7 

/ , -a y + ax-X x, 

X e dx 



"I 



- X x , 

X e dx - X e 



° y / 



( a-X ) x 
e dx 



-e 



- X x 



- ( A e~ ° y ) e ( “' X )x 
( a ~X ) 



1 - e - X y - » e~ ° y (e ( “ ' X )y -1) 

( a - X ) 



= 1 - e 



- x y 



» (e - X y - e‘ ° y ) 



( a - X ) 



Q . E . D . 



In an alternating renewal process, the probability that the process 
is in state 1 at time t is the sum of the probability that state 1 was 
occupied initially and the length of time spent in state 1 is greater 
than t, and the probability that the system, independent of where it 
started, left state 2 at a time t', for some t' < t, and the stay in state 
1 is greater than t - t' . In the limit, the value of this probability is 
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limit Pr(X^ = 1) 





t + 00 

A formal proof using the strong law of large numbers is presented by 
Cox [Ref . 8] . 

Another interpretation of the above equation is that after a very 
large number of transitions, the system will have spent a proportion of 
time m^ / ^ in state 1. 

Since p^ = = the ex Pected number of transitions into 

state 2 from state 1 as t 00 equals the expected number of transitions 
into state 1 . 



E. STATISTICAL CALCULATIONS 

When calculations are being made from sample data, the proba- 
bility of a transition from state i into state j is estimated as the number 
of observed transition from state i into state j divided by the total 
number of transitions from state i. Specifically 



where n.. is the number of observed transitions from state i into state j. 
i] 

Similarly, the mean length of time spent in any state i, con- 
ditional and unconditional, is simply the arithmetic mean length of 
time spent in state i from the observed data. -These values are called 
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the sample means 



and 



n 
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IV. CURVE FITTING 



The method of moments is employed for parameter estimation 
while attempting to fit a continuous distribution function to the data . 

The single parameter exponential distribution is assumed and the sample 
mean equated to the assumed population mean and a solution obtained 
for the unknown parameter. 

A. THE EXPONENTIAL DISTRIBUTION 

The exponential distribution function is 

Qij(t) = 1 " e ° U t 

has a mean value 

E(t) = 1 = m. . 

T - " 13 

u 

and a variance 




A convenient attribute of the exponential distribution is its 
"Memoryless" property. This property specifies that if the length 
of time spent in any state k is distributed exponentially, the remaining 
time in state k, given it has already been in state k for some time t^, 
is a random variable with an exponential distribution independent of t^. 
A proof follows: 
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Q(t) = 1 - e 



- a t 



q (t) = q e 



-at 



00 



Pr (t > Z) = 



f -at -a 

a e = e 



Pr (t > Z + t. 



t » . > = 



Pr (t > Z + t ). 
Pr (t i t x ) 



-a (Z+tJ -aZ 

= e 1_ = e 

-at 
e 1 



Pr (t > Z + t 



1 



t > t ) = Pr (t > Z) 



Q .E . D . 



When the conditional sample mean is equated to the mean of 
the exponential distribution in accordance with the hypothesis, (Ho), 
that the conditional time in state is distributed exponentially, the results 
are: 



m. . = t. | . 
i) i I 3 



ij 



i 1 



B. THE KOLMOGOROV-SMIRNOV GOODNESS OF FIT TEST 

The KOLMOGOROV-SMIRNOV TEST for goodness of fit, Massey 
[Ref. 9], is used to test the hypothesis that the data comes from an 
exponential distribution. The test is based on a comparison of the 
magnitude of the maximum difference between the set of sample values 
and the theoretical cumulative distribution as compared with tabulated. 
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critical values for the appropriate sample size at a specific level of 
significance. Specifically, if the assumed cumulative distribution is 



Q. .(t) = 1 - e ij 
i] 

and the observed cumulative step-function of the sample is 

R. .(t) = r 

1J 

i] 

where r is the number of observations less than or equal to t; then the 
sampling distribution of 



E. . = maximum Q. . (t) - R. . (t) 

ij ! ij i] 

is known and is independent of Q_(t). 

The tables associated with the Kolmogorov-Smirnov Test give 
critical values of the distribution of E for various sample sizes. For 
example, at a 0.20 level of significance, the critical value of E for 
n_ = 10 is 0.322; this means that in 20 percent of the random samples 
of size 10, the maximum absolute deviation between the sample cumu- 
lative distribution and the population cumulative distribution will be 
at least 0.322. If the calculated value of E is less than this critical 
value there is no reason to reject the hypothesis that the sample came 
from the assumed distribution. 

Reference 10 also compares this test with the chi-square test 
for goodness of fit and notes that it is superior in many cases. 
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V. THE TWO STATE MODEL 



The two state model considers the states of WAR and NO-WAR, 
and will be developed separately for each of the two possible modes of 
data interpretation. Initially a two state model which considers each 
military conflict, regardless of intensity or economic implications, as 
a state of WAR will be formulated because this is the typical classi- 
fication in studies involving cost-effectiveness. (Weapons systems 
employed vs weapon system not employed.) Subsequently, the inter- 
pretation of data such that all military conflicts which would not be 
classified as WAR in the three state model will be classified as NO-WAR. 

A. THE TRANSITION MATRIX 

The transition matrix for both of the two state cases is simply 

and uninterestingly 

W NW 

W 
NW 

B. TWO STATE MODEL (CASE I) 

In case one, all the periods of conflict, regardless of intensity, 

are considered periods of war. 

The periods of time during which a state of 1'10-WAR existed, 
as taken from Figure 1 are: 



0 1 . 
1 , 0 
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State of NW 



Length (mo.) 



Apr 1783 - Nov 1798 187 

Sep 1800 - Jul 1801 10 

Aug 1805 - Nov 1811 75 

Dec 1814 - Mar 1815 3 

Jun 1815 - Nov 1817 29 

May 1818 - Apr 1832 167 

Aug 1832 - Jun 1835 34 

Dec 1843 - Mar 1846 27 

Feb 1848 - Jan 1850 23 

Oct 1879 - May 1885 67 

Sep 1886 - Dec 1890 51 

Jan 1891 - Apr 1898 87 

Dec 1898 - Feb 1899 2 



The sample mean for the state 



State of NW 


enqth 


Jul 1905 - Oct 1906 


15 


Dec 1909 - Jan 1912 


25 


Jan 1913 - Apr 1914 


15 


Nov 1914 - Jul 1915 


8 


Sep 1915 - Mar 1916 


6 


Apr 1920 - Jan 1927 


81 


Nov 1928 - Jan 1931 


26 


Jan 1933 - Dec 1941 


106 


Aug 1945 - Jun 1948 


34 


Sep 1949 - Jun 1950 


9 


Jul 1953 - Jul 1958 


60 


Oct 1958 - Nov 1960 


25 


Dec 1960 - Dec 1961 


12 



NO-WAR, 



t NW 



_i 

n NW 



n NW 



I 



(k) 

t NW 



1184 = 45.5 months = 3.8 years 
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Similar calculations for the state of WAR yield the following 
result: 



= 1153 = 42.7 months =3.6 years 

W 27 

The value of 42.70 months for the mean length of time spent in 
a state of WAR is slightly conservative because it assumes a transition 
occurred at the data end points, i.e. , that a state of NO-WAR exists 
in March 1775 and February 1970. 
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The data on the length of stay in each state is assumed to have 



come from exponential distributions having parameters a = 0.0234 

W 

and a..,. = 0.0220 and mean values m,. =42.7 months and m XT ,. = 

NW W NW 

45.5 months . 

The resulting distributions, Q^(t) and Q^(t) are plotted against 
their respective cumulative step functions from the observed date in 
Appendix A. In both cases the Kolmogorov-Smirnov test for goodness 
of fit gives no indication that the exponential assumption, (Ho), is 
invalid, therefore Ho is accepted. 

Functionally these distributions answer the question, "Given that 
the United States is in a state of war, what is the probability that the 
war ends within two years, five years, ten years?" The answer, for 
this model is: 



Q w « - 1 - e 



-.0234 t 



Pr (t < 2 yrs) = (24) = 43% 

Pr (t < 5 yrs) = Q„ r (60) = 75% 

Pr (t < 10 yrs) = Q w (120) = 94% 

The mean recurrence time for the system is 



= ®NW = m W + m NW = 88 ‘ 2 m ° nths = 1A ye6rs 



The limiting probability that the system is in each of the two 
states, or the long run proportion of time spent in each state is 



= m NW = 45.5 - 

6 NW 



limit Pr(X t = NW) 
t -* 00 



88.2 



52% 



if 

limit Pr(X = WAR) = %£ = 42.7 = 4 8% 

t + oo 1 88 * 2 

The distribution function of the recurrence time for the system. 





G(t) = °W * °NW (t) 


where 


, . i -.0234 x 

« w W e 


and 


^ N . -.0220 x 

q nw w = 1 - e 


is 


G(t) = 1 - e"' 0220 * -(14.6) (e - - 0220 1 -e"' 0234 ') 



Using this distribution function answers can be obtained to 

questions such as, "Given that the U. S. is in a state of war at some 

time t , what is the probability that the U. S. will fight in a second 
o 

war within ten years of time t ? " 



Pr(X = WAR 



( 2 ) 



for some t, t < t < 10 yrs 



X = WAR (1) ) 



o 

= G(120) = 77% 

The average number of transitions into a state of war that a 
system with a life cycle of thirty years should expect to experience is 



T 1 

from the fact that 



30 yrs = 4 transitions 
7 . 4 yrs 



limit 
t +00 



n (t) 
t 



6 i 



n. 

) 



34 



C. TWO STATE MODEL (CASE II) 

In case II the periods of half-war and relative peace are grouped 
together as the state of NO-WAR. Only the major military conflicts 
classified as wars in the three state model are called states of WAR in 
this model. 

The periods of time during which a state of WAR existed, from 
Figure 1, are: 

STATE OF WAR LENGTH (months) 

Apr 1775 - Apr 1783 96 

Jun 1812 - Dec 1814 30 

Mar 1846 - Feb 1848 23 

Apr 1861 - May 1865 49 

Apr 1898 - Dec 1898 8 

Feb 1899 - Jul 1902 41 

Apr 1917 - Nov 1918 19 

Dec 1941 - Aug 1945 44 

Jun 1950 - Jul 1953 37 

Aug 1964 - Jan 1970 65 

Notice that again in this model a change of state is assumed to exist 
at the data end points . 

The sample mean from the above data, for the state of WAR is 



n. 



W 





412 =41.2 months = 3.4 years 



10 



V k=l 
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Calculations for the state of NO-WAR yield 



l NW 



1925 

9 



2 13 . 9 months = 17.8 years 



It is interesting to note that the difference in the average time 

spent in a state of WAR between Case I and Case II is less than two 

months, (42.7 mo. vs. 41.2 mo.) yet the average time spent in a state 

of NO-WAR varies by nearly a factor of five, (45.5 mo. vs. 213.9 mo.). 

The test of the hypothesis that the data is from exponential 

distributions with parameters = 0.0243 and a. T ,, r = 0.0047 is 

W NW 

contained in Appendix B. As a result of the test, the exponential 
hypothesis is accepted. 

Given that the U. S. is in a state of NO-WAR at some time t , 

o 

the probability that the country will escalate into a state of WAR during 
the next two , five or ten years is , 



q (t) = 1 - e 

V NW' ' 



-.0047 t 



Pr(X = WAR, for some t, t < t < 2 yrs I X = NW) = Q„„ r (24) = 11% 
t o - 1 t NW 



Pr(X = WAR, for some t, t < t < 5 yrs I X = NW) = <D (60) = 24% 
t o = t NW 

1 o 

Pr(X = WAR, for some t, t < t < 10 yrs I X v = NW) = Q. T ...(120) = 43% 
t o = It NW 

1 o 



The mean recurrence time for the system is 



= e NW = m W + m NW = 255>1 m ° = 21,3 years 
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The limiting probability that the system is in each of the two 



states, or the long run proportion of time spent in each state, is 



limit PrOC = NW) = m NW 
t -> 00 P NW 



213.9 mo. = 84% 
255.1 mo . 



limit Pr(X t = WAR) = = 41.2 mo. = 16% 

t -*■ 00 8 W 255.1 mo. 

The distribution of recurrence time for the system. 



G(t) = Q * Q (t) 
w V W NW 



where Q TAr (x) = 1 - e 

W 



-.0243 x 



and 



Q uw w = 



1 - 



-.0047 x 
e 



is 



. -.0047 t ... , -.0047 t -.0243 t. 

G(t) = 1 - e -(0.24) (e -e ) 



Given that a state of peace exists at time t , the probability 

o 

that the U . S . will have engaged in one war and returned to a state 

of NO-WAR within ten years of t is 

o 



Pr(X = WAR, = NW, for some t, and t„ , t < t < t_ < 10 yrs 
t^ t^ 12 0 12 — 



X = NW) = G(120) = 31% 
o 

The average number of escalations into states of WAR that a 
system with a thirty year life cycle should expect to experience is 
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T 



1 



30 yrs = 1 escalation 
21.3 yrs 



from the fact that 



limit 
t 00 



n.(t) 

_J 

t 



1 



6 , 



n. 

) 
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VI. THE THREE STATE MODEL 



The interpretation of data for the three state model is presented 
in Figure 1 . 



A. STATE TRANSITIONS 

The conditional sample mean time in state. 



n. . 
ij 



Mi 



I ,« 



n iJ 



k=l 



i 3 



the corresponding values of the exponential parameter, 



( 




1 




and the unconditional sample mean time in state 
s 



t 

i 




will be calculated and the three state transition matrix developed. 

It must be noted that the convenient assumption that a transition 
occurs at the data end point of January 1970 is of no value in this 
model because knowledge of the next state is not a certain event. The 
result of this conditional dependence on the next state visited is that 
the unconditional mean time spent in the state of WAR will be conserva- 
tive since it was computed from 
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s 



"V ' S/v = T-, p ij l i I J 

J=1 

and neither t . ,, r nor t,., , ... considers the length of the Vietnam 
W NW W HW 

conflict which has as a minimum length a value which would cause an 
increase in the computed average time spent in a state of WAR. 

NW - HW NW - W 


Nov 1798 


187 


Mar 1846 27 


Jul 1801 


10 


Apr 1898 87 


Nov 1811 


75 


Feb 1899 2 


Mar 1815 


3 


Dec 1941 106 


Nov 1817 


29 


Jun 1950 9 


Apr 1832 


167 


231 mo. 


Jun 1835 


34 




Jan 1850 


23 




May 1885 


67 




Dec 1890 


51 




Oct 1906 


15 




Jan 1912 


25 




Apr 1914 


15 


W = i/26 = 0 ' 15 


Jul 1915 


8 




Mar 1916 


6 


m . 46.2 mo . 

NW-W NW | W 


Jan 1927 


81 


= 3.9 yrs . 


Jan 1931 


26 




Jun 1948 


34 


a NW-w = 0 - 0216 


Jul 1958 


60 




Nov 1960 


25 




Dec 1961 


12 


= 45.5 mo. =3.8 yrs. 

N vV 



953 mo. 
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P NW-HW 21/26 0,81 



m NW-HW Vwl HW 45,4 m °* 3 . 8 yrs . 



a = 0.0220 

a NW-HW 



HW - NW 



HW - W 



Sep 1800 


22 


Jun 1812 7 


Aug 1805 


49 


Apr 1861 135 


Jun 1815 


3 


Apr 1917 13 


May 1818 


6 


Aug 1964 32 


Aug 1832 


4 


187 mo . 


Dec 1843 


102 




Oct 1879 


173 




Sep 1886 


16 




Jan 1891 


1 




Jul 1905 


36 




Dec 1909 


38 




Jan 1913 


12 


P HW-W ” 4/24 " °* 17 


Nov 1914 


7 


— 


Sep 1915 


2 


m HW-W = ^Wj W = 46 


Apr 1920 


17 


= 3. 


Nov 1928 


23 


a =0.0214 


Jan 1933 


24 


HW-W 


Sep 1949 


15 




Oct 1958 


3 




Dec 1960 


1 


rn , , = 30.1 mo. = 2.5 






HW 


p 


554 mo. 
= 20/24 = 0.83 




HW-NW 

m HW-NW 


= t NW 1 HW = 2 7 * 7 mo • 


= 2.3 yrs . 



“HW-NW = 0 - 0361 
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W - NW 



W - HW 



Apr 1783 


96 


Dec 1814 


30 


Feb 1848 


23 


Dec 1898 


8 


Aug 1945 


44 


Jul 1953 


37 



238 mo . 



May 1865 


49 


Jul 1902 


41 


Nov 1918 


19 




109 mo 



p = 6/9 = .67 

vV-NW 



p = 3/9 = .33 

vV-HW 



= 39.7 mo . 



m W-NW V| NW 39-7 m °‘ "V-HW VI HW 36 ' 3 m °' 

= 3.3 yrs . =3.0 yrs . 



° W-NW 



0.0252 



° W-HW 



0.0275 






38.6 mo .=3.2 yrs . 



The resulting transition matrix is 





NW 


HW 


W 


NW 


0 


.81 


.19 


HW 


00 

00 


0 


.17 


W 


.67 


.33 


0 



The distribution functions Q_(t) and R (t) are plotted for each i 
and j, and the value of E is determined in Appendix C. In no case 

ij 

is any cause for rejection of the hypothesis found, therefore it is 

accepted that the conditional time in state is exponentially distributed 

making the Semi-Markov process actually a Markov process. 
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The matrix of conditional transition distributions, Q = (Q ) , is 

ij 



NW 

HW 

W 



NW HW 



01 /, 0220t. 

.81 (1 — e ) 



W 



.19 (l-e~* 0216t ) 



.83 (l-e”'° 361t ) 0 

.67 (l-e"* 0252t ) .33 (l-e~* 0275t ) 



.17 (1-e 



— . 02 14t 



and the unconditional distribution of time spent in each state, 



QjCt) = Z Qjj ft) 



is: 



» ... . , 01 . - . 022 Ot , 1Q . - . 0216t 

Q NW (t) 1 - (• 81)e - (. 19)e 

~ u\ - 1 f - .0361t , - . 02 14t 

1 " (*83)e - (. 17)e 

HW 



n m-i / C 7u' l0252t , -.° 275t 

Q w W - 1 - (• 67)e - (. 33)e 



The following questions are typical of those which can be 

answered using these distribution functions. 

Given that a state of HALF -WAR currently exists, what is the 

probability that an escalation into a state of WAR will occur within 

the next five years and prior to a de-escalation into a state of peace? 

Statistically the question asks for the product of the probability that 

the next transition is from HW into WAR and the probability that the 

transition occurs within the next five years. 

The answer is obtained by simply evaluating the appropriate 

element of the Q matrix, at a time equal to five years. In this case 
- 0214t 

.17 (1-e * ) = 12%att=5 years . 
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Given a state of WAR exists, what is the probability that a de- 



escalation will occur within the next five years? 



Q w (t) = 1 - (• 67)e 



- . 0252t , ... -.0275t 

- (.33)e 



Q w (60) = 79%. 



B. MEAN RECURRENCE TIMES 



The equation for mean recurrence time 



1 < * >W < I 




(h , k) e 9 



may be described in a form more responsive to computational manipu- 
lations by attempting a "brute force" approach when the number of 



by beginning in state 1 and considering initially 

only those paths whose first transition is into state 2, it is possible 
to write an expression for the average length of time it would take to 
traverse each possible path, from state 1 back into state 1, times the 
probability of such a path being taken. For two, three and four tran- 
sitions, the expressions are respectively: 



states is sufficiently small to permit this tactic. 



For example, in a basic three state model. 




P 12 P 2 1 * m 12 + m 21 ^ 




p 12 ^23 P 32 ) P 2 1 (m 12 + m 23 + m 32 + m 21 } 
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It will soon be evident that the paths being described which 
contain an even number of transition form the series 
00 k 

£ p 12 P 21 fc 23 p 32> [ m 12 + rr> 2 1 + k(m 23 + m 32 ) ] 

k=0 

and those containing an odd number of transitions form the series 
00 k 

£ p 12 P 23 P 31 <P 32 p 23> [ m 12 + m 23 + m 31 + k (m 32 + m 23 ) ] 

k=0 

Notice that this approach applies because p = 0. 

n 

Because of symmetry in the mod*'! the paths from state 1 which go 
initially into state 3 form identical series with the subscripts 2 and 3 
reverse. Therefore, all possible first passage paths from state 1 may 
be explicitly counted . 

As stated previously, the product of the average length of time 
spent traversing each of these paths and the probability that such a 
path will be selected, when summed over all possible paths becomes 
the mean recurrence time ($), which in this instance is 
00 

6l = Y. P 12 P 21 <p 23 P 32 )k [ m 12 +m 21 +k (m 23 + m 32 , l 
k=0 

00 

+ Y P 12 P 23 P 31 <p 32 p 23 )k [ m 12 +m 23 + m 31 

k "° +k(m 32 +m 23 ) ] 

(cont’d) 
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00 



+ Y P 13 P 31 ^ P 32 P 23^ [ m 13 + m 31 + k ^ rn 32 + m 23^] 



k=0 



00 



+ Y P 13 P 32 P 21 ^23 P 32 ) [ m 13 + m 32 + m 21 



k=0 



+ k(m 23 + m 32 ) ] 



the term, P^) ' W H1 always be less than one, hence upon expanding 

the above equation, each term may be recognized as either a geometric 
series or a simple variation thereof, both of which have limits. 



Specifically, 

00 



z 

k=0 



a p = a 

(1 " P) 



P < 1 



00 



Y a k p k = a p 



P < 1 



k=0 (1 - p) 

The equation for mean recurrence time becomes 

^ = <— J >[P 12 P 21 S 2 + m 21> + p 12 P 23 P 31 (m 12 + m 23 + m 31> 

1 - p 23 P 32 

+ p 13 P 31 * m 13 + m 31* + p 13 P 32 P 21 * m 13 + m 32 + m 2 lO 



Poo P^ 



+ 23 — 32 [ m 32 +m 23][ P 12 P 21 +P 12 P 23 P 31 +P 13 P 31 +P 13 P 32 P 2l| 

(1 ~ P 23 P 32> 
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When this equation is used for the calculation of mean recurrence 
times the following results are obtained: 

B r = 2 52 .5 months =21 years 
W 

3„,., = 94.7 months = 7.9 years 
HW 

3-_. r = 87.4 months = 7.3 years 
NW 

The interpretation placed on these values is that over a great many 
years the average length of time the United States spends between states 
of WAR is twenty-one years , between states of NO-WAR approximately 
seven years , etc . 

A comparison can be made between the mean recurrence times 
suggested by the model and the arithmetic average recurrence times 
from the data, however, it should be noted that very close agreement 
should only be expected between the mean recurrence times for WAR. 

The end points of the data are both states of WAR \herefore the arithmetic 
average time between states of WAR involves no assumptions and should 
agree with the value suggested by the model. 

The longest interval between states of HALF -WAR is the con- 
servative 283 months which occurs before the first HALF -WAR. Current 
events indicate that the length of the Vietnam conflict is also a con- 
servative value and when applied as a mean recurrence time for HALF- 
WAR it becomes even more conservative because it may be followed by 
a period of NO-WAR before a recurrence of HALF -WAR. A similar 
argument applies to the state of NO-WAR; therefore it is expected that 
the arithmetic average recurrence time for HW and NW will be less than 



the value suggested by the model. 
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The values of mean recurrence time compare as follows: 



State 



calculated 
value from the 
model 



arithmetic 
average value from 
the data 



WAR 



253 mo 



2 14 mo 



HALF -WAR 



95 mo 



64 mo 



NO -WAR 



87 mo 



43 mo 



The large disparity between the calculated and sample value for 
the state of NO-WAR is a result of the fact that of the ten sample points 
where the length of time in a state was six months or less, seven 
appear as sample values of recurrence time for the state of NO-WAR. 
Perhaps the tactic of "display of strength" such as sending warships 
to protect Guatemala and Nicaragua in late 1960 or the Cuban Missile 
Crisis in 1962 should not be considered as states of HALF -WAR because 
of their brevity and the fact that weapons per se were not expended. 

This would certainly decrease the variance between the two values in 
question. Yet the possibility that the appearance of the majority of 
the small sample values as intervals between states of NO-WAR may be 

classified statistically as an unusual sample cannot be dismissed. The 

¥ 

sensitivity of the model to changes in data base is not investigated 
in the paper, however it is assumed, as an alternative to declaring the 
model a misfit, that a less than optimal method of historical data clas- 
sification plus the occurrence of a statistical rare event account for 
the difference between the two values . 
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C. PROBABILITY OF STATE OCCUPATION 

The limiting probability of finding the system in each of the three 
states , 

limit Pr(X = j) = i 

t 00 1 p. 

I 

is: 

limit Pr (X = WAR) = 38.6 = 15% 

t + 00 1 252.5 

limit Pr (X = HW) = 30.1 = 32% 

t -► 00 1 94.7 

limit Pr(X = NW) = 45.5 = 52% 

t -*• 00 1 87.4 

The probabilities do not sum to one because the mean time in 
state was calculated as the sum of tho conditional mean times and 
therefore precluded the use of all the data. The difference of 1% is 
considered insignificant. 

D. NUMBER OF ESCALATIONS INTO WAR STATES 
Employing the limiting probability that 

,. . n.(t) 

limit _j = 1 = n. 

t -»• 00 t 6. 1 

and the fact that 

n. . = n. p. . 

U i iJ 

the following type of questions can be answered. 
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Given a weapon system with a thirty year life cycle, the average 



number of war escalations, of each type, it should expect to witness is 



n NW-HW T = n NW P NW-HW T = 1 ( ‘ 81) (30) = 3 escalations 

7 • 3 

n NW-W ^ ~ n NW P NW-W ^ ~ (-19) (30) - 1 escalation 

7.3 

n HW-W ^ _ n HW P HW-W ^ _ (• 1^) (30) ~ 1 escalation 

7*9 



E. LIFE CYCLE COST EQUATION 



Using the limiting values obtained for the three state model, the 

long run, average life cycle cost equation of chapter I can be written 

more explicitly for a weapon system with a life cycle of T years, as: 

Life Cycle Cost = (R&D cost) + (Peacetime Investment cost) 

+ (.111 T) (Investment cost/transition) , r 

NW-HW 

+ (.026 T) (Investment cost/transition), ,. r 

NW-W 

+ (.021 T) (Investment cost/transition) TT ,, r 1Ar 

HW-W 



+ (.52 T) (Annual Ops. Cost 
+ (.32 T) (Annual Ops. Cost 



PEACE^ 
HALF -WAR 



) 



+ (.15T) (Annual Ops. Cost^^) 

In this form it is conceivable that such an c-quation could be 
of value to a decision maker. 
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VII. COMPARISON OF RESULT FROM EACH MODEL 



The following is a tabulation of the important results from the 



three cases investigated. 


All times are in months. 




2 - State 




3 - State 


Case I (HW=W) 


Case II (HW=NW) 




m NW 45 ' 5 


213.9 


45.5 


m HW 




30.1 


"V 42 - 7 


41.2 


38.6 


B Ar 88.2 
NW 


255.1 


87.4 


3 

HW 




94.7 


V 88 - 2 


255.1 


252.5 


limit Pr (X =NW) .52 
t -v 00 1 


.84 


.52 


limit Pr(X =HW) 
t -v 00 




.32 


limit Pr (X =W) .48 


.16 


.15 



t -> 00 

The results provided by Case I of the two state model compare 
more favorably with the results of thv three state model, (except for the 
mean recurrence time of war) than those of Case II, however it should 
not be assumed from this that Case I is to be preferred to Case II. 

If conditions necessitated the use of a two state model the nature 
of the problem and type of solution desired would indicate the more 



preferable case . 
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VIII. CONCLUSION 



In the author's opinion, the area most susceptible to error is that 
of data identification and classification. Further it is felt that this 
error will be minimized if the historical data utilized is restricted to 
conflicts of the specific type or style of combat being considered in 
the problem at hand. For example, in a cost-effectiveness study for 
the selection of the best among several amphibious landing vehicles 
the historical data should be restricted to conflicts which included 

* V 

amphibious assaults. 

The reader is warned against using the model to predict a specific 
event or to answer questions such as, "Given the U. S. is in a state 
of WAR in January 1970, what is the probability that the war will end 
by January 1973?" The values obtained from the model are the average 
values to be expected over a long period of time and their use in pre- 
dicting individual occurrences should be avoided. 

The simplicity of the model, as indicated by the fact that all 
the calculations can be done by hand, should encourage its use as a 
tool in cost-effectiveness methodology and encourage an extension of 
the technique to other applications . 



52 



2 STATE MODEL CASE I (HW = W) 



APPENDIX A 



o 
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time (months) 



2 STATE MODEL CASE I (HW = W) 
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time (months) 



APPENDIX B 
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time (months) 



2 STATE MODEL CASE II (HW = 




1 

W 
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time (months) 



3 STATE MODEL 
NO WAR - HALF WAR 



APPENDIX C 



o 

o 

CM 




LO 



o 

LO 



LO 

CM 



O 

O 



LO 



o 

LO 



LO 

CM 
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1 




0^ 
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CO 
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o 

CM 



LO 
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O 

CT) 



LO 

C^ 
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LD 



LO 



O 
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LO 
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time (months) 



3 STATE MODEL 
HALF WAR - NO W. 
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3 STATE MODEL 
/VAR - HALF WAR 
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00 
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